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Abstract 



state (in a number of different settings), that approximation of infinitely differentiable 
functions is intractable and suffers from the curse of dimensionality. We show that 
renorming the space of infinitely differentiable functions in a suitable way allows weakly 
tractable uniform approximation by using only function values. Moreover, the approx- 
imating algorithm is based on a simple application of Taylor's expansion about the 
center of the unit cube. We discuss also the approximation on the Euclidean ball and 
the approximation in the Li-norm. 

' Key words: weak tractability, uniform approximation, infinitely differentiable functions, 

curse of dimensionality 

1 Introduction 

O 

CO I We consider different classes Fd of infinitely-differentiable functions / : R'' — > M and discuss 

algorithms using only function values of / in order to approximate / uniformly, or in the 
Li-norm. We are especially interested in the case of large d ^ 1. 

In the classical setting of approximation theory, the dimension of the Euclidean space 
d is fixed. Furthermore, the decay of the minimal error e(n) of approximation of smooth 
. functions in a Lebesgue space norm is very well studied for both algorithms using n arbitrary 

linear functionals and for algorithms using only n function evaluations. We refer to [SJ 
El [71 [121 [m [IB [H] and references therein. The decay is usually polynomial, speeds up 
with increasing smoothness and slows down with increasing dimension. Furthermore, this 
terminology typically hides the dependence of the constants on the dimension d, which might 
be even exponential. This motivates the question, what happens if both the dimension d 
and the smoothness parameter s tend to infinity. 

If n{e,d) denotes the minimal number of function values needed to approximate all 
functions from Fd up to the error £ > 0, we say, that the problem suffers from curse of 
dimensionality, if n(e, d) grows exponentially in d. This means, that there are positive 
numbers c, Eq and 7, such that 

n-ie, d) > c(l + 7)*^ for all < e < eo and infinitely many d £ N. 
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On the other hand, we say that the problem is weakly tractable if 

lim h^ = o. 

Furthermore, the problem is quasi-polynomially tractable in the sense of [T], if there exist 
two constants C,t > 0, such that 

n{e,d) < Cexp{<(l + ln(l/e))(l + ln(rf))} (1) 

for all < e < 1 and all d E N. For the sake of completeness, we add that a problem is 
polynomially tractable if there exist non- negative numbers C, p and q such that 

n{e, d) < Ce^Pd'i for all < e < 1 and d G N. 

If g = above then a problem is strongly polynomially tractable. We refer to the monographs 
[T51 [5] and [TT] for a detailed discussion of these and other kinds of (in)tractability and the 
closely related field of information based complexity. 

The Loo-approximation of infinitely differentiable functions was studied in [?], where 
the authors showed, that the problem is not strongly polynomially tractable. It was also 
discussed in [5| , cf. Open Problem 2 therein. An essential breakthrough was achieved in [TU] 
(which in turn is based on [5] and answers an open problem posed there), where uniform 
approximation of the functions from the class 

Fd = {/: [0,1]'^^K: sup ||i?"/||oo < 1} 

was shown to satisfy n{e,d) > 2^"^^^^ for all < e < 1 and all d G N and this result is 
also true if arbitrary linear functionals are allowed as the information map about /. Hence, 
the problem is intractable and suffers from the curse of dimensionality. In the context of 
weighted spaces of infinitely differentiable functions, the problem was also discussed in [T5] . 

Multivariate integration of infinitely differentiable functions from the class was conjec- 
tured not to be polynomially tractable in [20j and was shown not to be strongly polynomially 
tractable in [TH]. Furthermore, it is known (cf. [13] and [5]) that multivariate integration of 
functions from 

C',={f -.[0,1]' ^R: sup \\DV\\oo<l} 

a:\a\<k 

suffers from the curse of dimensionality for all k G N. Although multivariate integration of 
infinitely differentiable functions is also discussed in and [3], it seems to be still an open 
problem if the curse of dimensionality holds also for multivariate integration and the class 

The main result of this paper is the following. 

Theorem 1. (i) Uniform approximation on the cube [—1/2,1/2]'^ of functions from the 
class 




is quasi-polynomially tractable. 

(a) Uniform approximation on the balls i?(0, r^) — {x £ R'^ : ||2^||2 < Td}, where rd are 
chosen in such a way, that the volume of B(0,rd) is equal to one, and the functions 
are from the class 

Fj = {/ e C°°(B(0,r,)) : sup ll^^VlU < 1} (3) 

is weakly tractable. Here, {d^f){x) denotes the k-th derivative of f at x in the 
"normal" direction a;/||x||2. 
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(in) Approximation in the Li-norm on B(0,rd), where rd are as above and the functions 
are from the class 

Fj - {/ e C°°(i?(0, ra)) : sup C 5(9^/, r)dr < l] (4) 

is weakly tractable. Here S{dl^f,r) are the averages of \d^f\ on the sphere rS**^^. 

Our method is rather simple and involves only the Taylor's expansion of a smooth func- 
tion about the center of the domain under consideration. The next two sections of this paper 
are devoted to the proof of this theorem. Finally, the last section presents some possible 
extensions of this method and mentions several closely related open problems. 



2 Uniform approximation 

We study first the uniform approximation of infinitely differentiable functions / using only 
its function values. Let us recall, that the paper of Novak and Wozniakowski [TU] shows 
intractability of this problem on the unit cube even for arbitrary linear functionals as the 
information map of /. We show that modifying the norm in a suitable way leads immediately 
to weak (and even quasi-polynomial) tractability, even when allowing only function values 
of / as the admissible information and using only Taylor's expansion about the center of the 
cube or ball, respectively. Of course, any tractability result for approximation using function 
values implies the same result also for algorithms using arbitrary linear information. On the 
other hand, we leave it as an open problem if algorithms using general linear information 
could achieve even better art of tractability. 

Let us recall the standard multivariate notation, which we shall use with connection to 
the Taylor's theorem. If a = (ai, . . . , ad) € Nq is a multiindex, we denote 



|q;| = ai H h ad, 

dx'^' ...dx° 



ai! . . .ad!, 



. x^'', xe 



2.1 Unit cube 

In this part, we study uniform approximation of infinitely differentiable functions on [—1/2, 1/2]^^. 
Our algorithm is based on Taylor's formula 



f{x)^{Tkf){x)+ iRpf)i^>- 



l/3|=fc+l 

where 



Q|<fc 



^1 

1 
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The approximation of / by T^/ at the point x E [—1/2. 1/2]'' resuhs into an error 

l/9|=fc+l 

< 



\f{x)-nf{x)\< \Rpfi^)\-\^-^ 



l_7.. I 1 

E f\^-trdt-\\D^f\U 
1-1, ,1 "'o 



l/3|=fc+l 
fc+1 

< 



1 

2, 

|^l|=/c+l 
^ |/3|=fe+l ^ 



Hence, 

sup < ( ^ 

for every fc e Nq, where was defined in ([5]). To discuss the tractability of the problem, 
we need to estimate also the number of points needed to recover Tfe/. As we are allowed to 
take only samples of /, and not of its derivatives, we are actually not able to recover T^f 
exactly. But using finite order differences, we may approximate it to an arbitrary precision 
using a bounded number of points. 

To estimate the number of sampling points needed to approximate all derivatives up to 
the order fc, we use induction. To evaluate /(O) we need to sample / at the point ~ {0}- 
To calculate the first order differences, we need the points from the set 

d 

Ai^Ao\J |J(^o + /iej), 
which has d + 1 points. For the second order differences, we need the values at 

d 

A2 := Aiij\j{Ai + hcj) = {h{ai, . . . ,ad) : a £ni,\a\ < 2}, 
j=i 

which has i^^^') points. By induction we obtain, that to evaluate all finite order differences 
up to the order fc, we need the values at 

Ak = {h{ai,...,ad) : \a\ < k} 

and that this set has 
points. 

To show that the problem is quasi-polynomial tractable, we proceed in the following way. 
Given an 1 > e > 0, we choose the smallest fc S Nq, such that 

e> ' 



/In K+i 
[2) ' 



. + l:4MV£)" 
ln2 
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where \a] denotes the smahest integer, which is larger than or equal to the real number 
a € K. Together with the estimate 



this gives that there is i > 0, such that 

lnn(e,d) < k{l + \-a{d + k) - Ink) < i(l + ln(l/e))(l + Ind). 
This immediately implies ([1]), i.e. the quasi-polynomial tractability. 

2.2 Euclidean ball 

In this section, we discuss the uniform approximation of an infinitely differentiable function 
/ on an Euclidean ball in R" with radius > 0. As all the sets of infinitely differentiable 
functions under consideration include all constant functions with values between -1 and 1, 
the initial error of approximation is always 1 for every sequence {rd)dGN- Nevertheless, we 
shall be interested at most in the case, when the Lebesgue measure of B{0, Vd) ■= {x gM.'^ : 
\\x\\2 < rd} is one. It is very well known, cf. [5], that ~ Vd in this case, i.e. there are 
two absolute constants C > c > 0, such that c^/d <rd< CVd. 

We start again with Taylor's expansion of an infinitely differentiable function / about 
zero. Let x € B(0,rd),a; 7^ and let g^{t) = f{tx),0< t < 1. Then 

fix) = = ^ + ^ !\l - ifg^-^'-^m. (5) 



j\ k\ 



Iterating the formula 



m = ((v/)(te),.T) = ((v/)(te), ^)M2 = . 

we obtain 

g^^+'^it) = {dt'''mx)-\\x\\l+\ 0<i<l, 

where {d^f){x) denotes the derivative of / at x 7^ in the direction x/|la;||2. 
We denote 

#(0) 



which allows to estimate the error of approximation of f{x) by the Taylor's polynomial 
about X by 



\f{x) - nf{x)\ < / (1 - t)^- • 







{k + iy. -(fc + i)!' 

if / e F|, where is as in 

Finally, we observe that we need again ('*^'^) points to approximate the derivatives 
D^fiO) for every \a\ < k, which again allows to approximate all the derivatives ^^"'''(O) for 
all X e J5(0, Td) and aU < j < k. 

Hence, if d G N is fixed and 1 > e > is given, we choose first the smallest fc, for which 

-(fc + 1)! 
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/ erd 
Vfc+ 1 



fc+i ^ 



This is always possible, as the right hand side goes to zero for d fixed and k ^ oo. On the 
other side, let us mention that if 1^ holds for e < 1, then k is at least of the order r^. Using 
the estimate 

'_d 

{k + l)\ 

we obtain that © is satisfied any time we have 

k > max(e'^rrf, ln(l/e)). 
If finally ~ Vd, this implies the weak tractability of the problem by 

lnn(e,d) k(l + ln(d + k) - \n k) feln(d + fc) 
lim < lim -^^-^ — ^ , ; < lim \ = 0. 

e-i+d^oo e -'- + d e-i+d-i-oo E + d e-i+d^oo £ + d 

Unfortunately, the calculation above does not give quasi-polynomial tractability in this case. 

3 Approximation in the Li-norm 

In this section we prove the last part of Theorem [TJ Of course, on a domain with volume 
one, the error of approximation in the Li-norm may be bounded from above by the error 
of uniform approximation. Therefore, the problem is weakly tractable for the class 
considered above. Using again ([5]) for all x £ B{0,rd),x ^ 0, we obtain 

\!{x) - nf{x)\dx < I /V - tf\{dt+'f){tx)\dtdx 

B(G,ri) JBiQ.Xd) Jo 

^ / / \\y/t\\^+\l-tndi;+'f)iy)\t-^dydt 

Jo<t<l "'0<||y||2<tr'd 

k\ 
1 



Ily|l2+' • • / - tft-'^dtdy 



<ry / llyll2+'-l(5rV)(y)|- / t-^^'+'+'^dtdy 
<U llylir • • • (^y'~'dy (7) 

k\ JB(O.ra) k + d \ Td J 

^ ' 'ij/ii2"'-i(arv)(2/)My 



fc! k + d 



S(0,rd) 



= T^-TT-J '''' / \id'.^'f){y)\d<j{y)dr, 
k\ k + d Jq Jrs-i-^ 

where a is the d — 1 dimensional Hausdorff measure in IR'^ and S''"^ = {a; e K'^ : ||a;||2 = 1} 
is the unit sphere in R''. If we denote by uJd-i the surface area of S'^"^, i.e. oJd-i = ct(S''~^), 
and by 

Sidt+'f,r) = / Id^-^'midaiy) 

the averages of on the sphere rS''^^, we obtain 

\fix) - nf{x)\dx < - ■ • LOd^i / 5(9^V,r)dr. 

B(0,rd) k\ k + d 7o 
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Assuming finally, that the volume of the B{0,rd) is equal to ujd-ifd/d. = 1, we may further 
reduce this to 

/ - nf{x)\dx < ^ r Sidt+^f, r)dr, 

JB{a,ra) ^- Jo 

which is smaller than r^/fc! for every 

/ G Fj^, cf. dH), or smaller than r'^+^/k\ for every 

f € F^, where 

F^ = {/ e C°°(B(0,r,)) : sup sup 5(9^+7,0 < l|. 

The proof of weak tractability follows in both cases from these estimates exactly as in 
Section!^ 

4 Extensions and closing remarks 

The aim of this paper was to discuss the use of Taylor's theorem for tractability of ap- 
proximation of infinitely differentiable functions. Therefore, we have restricted ourselves in 
Theorem [T] to the classes F^,F^,F^ and simple domains as balls and cubes. Nevertheless, 
the method used here may be directly generalized also to other situations. 

Remark (Possible extensions): (i) The point (i) of Theorem [1] which deals with 
uniform approximation on the cube for the class Fj, holds also for the classes 

F](c) = {/ e C-([-l/2, l/2f) : J2 < for all e No}, (8) 

\l3\=k 

where c < 2 is a fixed number. The analysis done in Section [2.11 applies literally also to this 
setting. 

(ii) The statements of points (ii) and (iii) of Theorem [T] hold true also when and F^ are 
replaced by 

Fj{c)={f eC°^{B{Q,ra)):\\dlf\\^<c'' for all fc e No} (9) 

or 

F!{c) = {f eC°^{B{0,rd)): S{d'^f,r)dr<c'' for all fc e No}, (10) 

respectively. Here, c < cx) is arbitrary. Actually, one observes that even c = d^/"^^^ for some 
fixed (5 > is still admissible. Again, also in these cases, the analysis done in Section [Z2l or 
Section [3] applies. 

(iii) The analysis of Section [52] was done for a sequence of balls B{0,rd) C K.'*. Although 
we concentrated in the very end on the case, when the volume of B{0,rd) is equal to one 
(i.e. rd ~ "/d), the same calculation applies also to the case when < Cd^~^ for two 
universal constants C > and & > {). Furthermore, the same is true for star-shaped subsets 
of such balls with zero in their center. Therefore, the statement applies also to unit cube 
[-1/2,1/2]'^. 

(iv) When trying to generalize the analysis of Section [3| to other domains, we encounter 
several problems. The crucial calculation ([7]) made a heavy use of spherical coordinates 
and they were also used in the definition of S{d^'^^f,r). Although these obstacles can 
be overcome by measuring the size of d^'^^f in a certain weighted space, we avoid the 
technicalities and do not give the details. 

Remark (Open problems): (i) We have provided only the upper bounds on n{e,d), 
which in turn led to tractability results for the classes F^,F^, and Fj^, respectively. It would 
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be interesting to know, if these results are optimal, i.e. to show that these results can not 
be improved. We leave this as an open problem. 

(ii) We studied only algorithms using the function values of /. Of course, the presented 
tractability results also apply to the larger class of algorithms using arbitrary linear func- 
tionals. Nevertheless, we leave as an open problem if such algorithms may achieve a better 
art of tractability than the one presented here. 

(iii) One could also modify the classes under consideration in a way used recently in [3]. 
This approach uses a sequence L = {Ld)d&i to define, for example, 

Fj{L) = {/ e C°°(S(0,r,)) : sup WdtfU < M- 

Of course, the calculations given above could be to some extent transferred also to this 
setting, and we could really prove similar results for sequences which do not grow too 
quickly. Unfortunately, due to the lack of lower estimates, we could not hope for being able 
to characterize sequences L, for which weak (or quasi-polynomial) tractability still holds. 
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